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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
February 28, 2008 has been entered. Claims 1, 2, 5, 6, 7, and 10 are currently pending. 

Response to Arguments 

Applicant's arguments with respect to claim 1 , 2, 5, 6, 7 and 10 have been 
considered but are moot in view of the new ground(s) of rejection. As per corrections by 
Applicant, Examiner withdraws the 35 U.S.C. 112 rejections to claims 1, 2 and 5. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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Claims 1, 2, 5, 6, 7, and 10 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Tamura et al (US 6,040,860) and Kanzaki et al. (6,137,531). 

Regarding claim 1, Tamura discloses an image processing device for acquiring 
image data to be processed ("comprises an imaging element for outputting an image 
signal", column 2, line 62), extracting a spectrum of a predetermined physical quantity in 
said image data ("FIG. 4 is a sample luminance histogram showing the feature quantity 
extracted by the feature quantity extraction circuit 107", column 4, line 28), making a 
determination as to whether or not said spectrum has a plurality of peaks ("This 
luminance histogram (FIG. 4bcd) shows that there are two luminance peaks with one in 
the low luminance range and one in the high luminance range. This makes it possible to 
deduce that the captured image contains a backlit subject.", column 8, line 65), and 
performing a process based on a result of the determination, wherein the process is a 
backlighting correction process(The image evaluation means 108 then sets the 
compensation rate of the gradation compensation characteristic used to compensate 
the input image based on the luminance histogram extracted by the feature quantity 
extraction circuit 107, column 9, line 2), wherein the determination as to whether or not 
said spectrum has a plurality of peaks is made based on, with respect to said spectrum, 
an integral value of a range where said physical quantity is no greater than a first 
threshold, and an integral value of a range where said physical quantity is no smaller 
than a second threshold which is greater than said first threshold ("FIG. 4 is a sample 
luminance histogram showing the feature quantity extracted by the feature quantity 
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extraction circuit 107 in the present embodiment of the invention. Curve a in FIG. 4 is 
the luminance histogram where the low luminance pixel count of pixels with a luminance 
value less than or equal to threshold value 1 is level b, the middle luminance pixel count 
of pixels with a luminance value between threshold value 1 and threshold value 2 is 
level c, and the high luminance pixel count of pixels with a luminance value greater than 
or equal to threshold value 2 is level d.", column 7, line 6; "This luminance histogram 
(FIG. 4bcd) shows that there are two luminance peaks with one in the low luminance 
range and one in the high luminance range. This makes it possible to deduce that the 
captured image contains a backlit subject.", column 8, line 65). 

Tamura does not disclose wherein at least one of said first and second 
thresholds is set based on an average level of said physical quantity of said image data . 

Kanzaki teaches wherein at least one of said first and second thresholds is set 
based on an average level of said physical quantity of said image data (Kanzaki, 
column 8, lines 18-22). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify the invention of Tamura to include thresholds being set based on the 
average level of luminance of said image data as taught by Kanzaki rather than having 
predetermined or fixed thresholds so that, as stated in the Kanzaki reference in column 
8 between lines 18 and 22, "depending on the calculated average value of luminance, 
the automatic threshold value section 12 determines a threshold value necessary for 
subsequent Step 3. As the average value of luminance becomes larger, a larger 
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threshold value is determined." In this way, since threshold values are determined for 
the actual images based on the image's actual characteristics, it will provide 
backlighting information more relevant to the chosen inputted images. 

Regarding claim 2, Tamura discloses the image processing device according to 
claim 1, wherein said physical quantity is a signal varied in accordance with a change in 
an amount of light or a luminance ("FIG. 4 is a sample luminance histogram showing the 
feature quantity extracted by the feature quantity extraction circuit 107", column 4, line 
28) . 

Regarding claim 5, Tamura discloses the image processing device according to 
claim 3, wherein said first threshold is smaller than the average level of said physical 
quantity, and said second threshold is greater than the average level of said physical 
quantity(Fig. 4 and Fig. 5a; column 7, lines 6-16, Tamura is separating a histogram 
spectrum into three luminance regions and because the average luminance is related to 
the middle luminance region (Fig. 5a) in order to evaluate the amount of backlighting in 
a typical image input signal (column 8, lines 56-58; Fig. 3), the first threshold is smaller 
than the average level of the luminance, and said second threshold is greater than the 
average level of the luminance.), and said spectrum is determined as having a plurality 
of peaks when satisfying at least two conditions out of: a first condition that an integral 
value of a range where said physical quantity is no greater than said first threshold is no 
smaller than a first percentage of an integral value of the entire range(column 7, line 9- 
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11; column 7, line 17-20; Fig. 2, num. 107 and 108); a second condition that an 
integral value of a range where said physical quantity is no smaller than said second 
threshold is no smaller than a second percentage of the integral value of the entire 
range (column 7, lines 14-16; column 7, line 21-22; Fig. 2, num. 107 and 108) ); and a 
third condition that a sum of the integral value of the range where said physical quantity 
is no greater than said first threshold and the integral value of the range where said 
physical quantity is no smaller than said second threshold is no smaller than a third 
percentage of the integral value of the entire range. 

Regarding claim 6, Tamura discloses an image processing method for acquiring 
image data to be processed ("comprises an imaging element for outputting an image 
signal", column 2, line 62), extracting a spectrum of a predetermined physical quantity in 
said image data ("FIG. 4 is a sample luminance histogram showing the feature quantity 
extracted by the feature quantity extraction circuit 107", column 4, line 28), making a 
determination as to whether or not said spectrum has a plurality of peaks ("This 
luminance histogram (FIG. 4bcd) shows that there are two luminance peaks with one in 
the low luminance range and one in the high luminance range. This makes it possible to 
deduce that the captured image contains a backlit subject.", column 8, line 65), and 
performing a process based on a result of the determination, wherein the process is a 
backlighting correction process(The image evaluation means 108 then sets the 
compensation rate of the gradation compensation characteristic used to compensate 
the input image based on the luminance histogram extracted by the feature quantity 
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extraction circuit 107, column 9, line 2), wherein the determination as to whether or not 
said spectrum has a plurality of peaks is made based on, with respect to said spectrum, 
an integral value of a range where said physical quantity is no greater than a first 
threshold (, and an integral value of a range where said physical quantity is no smaller 
than a second threshold which is greater than said first threshold ("FIG. 4 is a sample 
luminance histogram showing the feature quantity extracted by the feature quantity 
extraction circuit 107 in the present embodiment of the invention. Curve a in FIG. 4 is 
the luminance histogram where the low luminance pixel count of pixels with a luminance 
value less than or equal to threshold value 1 is level b, the middle luminance pixel count 
of pixels with a luminance value between threshold value 1 and threshold value 2 is 
level c, and the high luminance pixel count of pixels with a luminance value greater than 
or equal to threshold value 2 is level d.", column 7, line 6; "This luminance histogram 
(FIG. 4bcd) shows that there are two luminance peaks with one in the low luminance 
range and one in the high luminance range. This makes it possible to deduce that the 
captured image contains a backlit subject.", column 8, line 65). 

Tamura does not disclose wherein at least one of said first and second 
thresholds is set based on an average level of said physical quantity of said image data . 

Kanzaki teaches wherein at least one of said first and second thresholds is set 
based on an average level of said physical quantity of said image data (Kanzaki, 
column 8, lines 18-22). 



Application/Control Number: 10/823,898 Page 8 

Art Unit: 2624 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify the invention of Tamura to include thresholds being set based on the 
average level of luminance of said image data as taught by Kanzaki rather than having 
predetermined or fixed thresholds so that, as stated by the Kanzaki reference in column 
8 between lines 18-22, "depending on the calculated average value of luminance, the 
automatic threshold value section 12 determines a threshold value necessary for 
subsequent Step 3. As the average value of luminance becomes larger, a larger 
threshold value is determined." In this way, since threshold values are determined for 
the actual images based on the image's actual characteristics, it will provide 
backlighting information more relevant to the chosen inputted images. 

Regarding claim 7, Tamura discloses the image processing method according 
to claim 6, wherein said physical quantity is a signal varied in accordance with a change 
in an amount of light or a luminance ("FIG. 4 is a sample luminance histogram showing 
the feature quantity extracted by the feature quantity extraction circuit 107", column 4, 
line 28). 

Regarding claim 10, Tamura discloses the image processing method 
according to claim 7, wherein said first threshold is smaller than the average level of 
said physical quantity, and said second threshold is greater than the average level of 
said physical quantity (Fig. 4 and Fig. 5a; column 7, lines 6-16, Tamura is separating a 
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histogram spectrum into three luminance regions and because the average luminance 
is related to the middle luminance region (Fig. 5a) in order to evaluate the amount of 
backlighting in a typical image input signal (column 8, lines 56-58; Fig. 3), the first 
threshold is smaller than the average level of the luminance, and said second threshold 
is greater than the average level of the luminance.), and said spectrum is determined as 
having a plurality of peaks when satisfying at least two conditions out of: a first condition 
that an integral value of a range where said physical quantity is no greater than said first 
threshold is no smaller than a first percentage of an integral value of the entire range 
(column 7, line 9-1 1 ; column 7, line 17-20; Fig. 2, num. 107 and 108); a second 
condition that an integral value of a range where said physical quantity is no smaller 
than said second threshold is no smaller than a second percentage of the integral value 
of the entire range (column 7, lines 14-16; column 7, line 21-22; Fig. 2, num. 107 and 
108); and a third condition that a sum of the integral value of the range where said 
physical quantity is no greater than said first threshold and the integral value of the 
range where said physical quantity is no smaller than said second threshold is no 
smaller than a third percentage of the integral value of the entire range. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ELISA M. RICE whose telephone number is (571)270- 
1582. The examiner can normally be reached on 8:00a.m. -5:30p.m. EST Monday thru 
Friday. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Brian P. Werner can be reached on (571)272-7401 . The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Elisa Rice 

2624 Patent Examiner 

/Elisa M Rice/ 
Examiner, Art Unit 2624 



/Brian P. Werner/ 

Supervisory Patent Examiner, Art Unit 2624 



